Drug Safety Monitoring in Children: Performance of Signal Detection Algorithms and Impact of Age Stratification

Introduction: Spontaneous reports of suspected adverse drug reactions (ADRs) can be analyzed to yield additional drug safety evidence for the pediatric population. Signal detection algorithms (SDAs) are required for these analyses; however, the performance of SDAs in the pediatric population specifically is unknown. We tested the performance of two SDAs on pediatric data from the US FDA Adverse Event Reporting System (FAERS) and investigated the impact of age stratification and age adjustment on the performance of SDAs. Methods: We tested the performance of two established SDAs: the proportional reporting ratio (PRR) and the empirical Bayes geometric mean (EBGM) on a pediatric dataset from FAERS (2004–2012). We compared the performance of the SDAs with a published pediatric-specific reference set by calculating diagnostic test-related statistics, including the area under the curve (AUC) of receiver operating characteristics. Impact of age stratification and age-adjustment on the performance of the SDAs was assessed. Age adjustment was performed by pooling (Mantel-Hanszel) stratum-specific estimates. Results: A total of 115,674 pediatric reports (patients aged 0–18 years) comprising 893,587 drug–event combinations (DECs) were analysed. Crude values of the AUC were similar for both SDAs: 0.731 (PRR) and 0.745 (EBGM). Stratification unmasked four DECs, e.g., ‘ibuprofen and thrombocytopenia’. Age adjustment did not improve performance. Conclusion: The performance of the two tested SDAs was similar in the pediatric population. Age adjustment does not improve performance and is therefore not recommended to be performed routinely. Stratification can reveal new associations, and therefore is recommended when either drug use is age-specific or when an age-specific risk is suspected

Dyadic adjustment and spiritual activities in parents of children with cystic fibrosis

Children's diseases can negatively impact marital adjustment and contribute to poorer child health outcomes. To cope with increased marital stress and childhood diseases severity, many people turn to spirituality. While most studies show a positive relationship between spirituality and marital adjustment, spirituality has typically been measured only in terms of individual behaviors. Using the Dyadic Adjustment Scale (DAS) and Daily Phone Diary data from a sample of 126 parents of children with cystic fibrosis as a context for increased marital stress, spiritual behavior of mother-father dyads and of whole families were used as predictors of marital adjustment. Frequency and duration of individual, dyadic and familial spiritual activities correlated positively with dyadic adjustment. Significant differences in spiritual activities existed between couples with marital adjustment scores above and below the cutoff for distress. The only significant factors in regressions of spiritual activities on marital adjustment scores were number of pulmonary exacerbations and parent age. Higher odds of maintaining a marital adjustment score greater than 100 were significantly associated with spending approximately twelve minutes per day in individual, but not conjugal or familial, spiritual activities. The Daily Phone Diary is a feasible tool to study conjugal and familial activities and their relationships with beliefs and attitudes, including spirituality

Pandemic influenza vaccine & narcolepsy: Simulations on the potential impact of bias

Several studies have identified an association between PandemrixTM, an AS03 adjuvanted pandemic influenza A(H1N1) vaccine, and narcolepsy, a rare and under-diagnosed sleep disorder with a median onset-to-diagnosis interval of ten years. This paper reviews potential sources of bias in published studies and aims to provide, through simulation, methodological recommendations for assessment of vaccine safety signals. Our simulation study showed that in the absence of an association between the vaccine and the outcome, presence of detection bias and differential exposure misclassification could account for elevated risk estimates. These may play a major role, particularly in alert situations when observation times are limited and the disease has a long latency period. Estimates from the case-control design were less inflated than those from the cohort design when these biases were present. Overall, these simulations provide useful insights for the design and interpretation of future studies

ADVANCE system testing: Can safety studies be conducted using electronic healthcare data? An example using pertussis vaccination

Introduction: The Accelerated Development of Vaccine benefit-risk Collaboration in Europe (ADVANCE) public-private collaboration, aimed to develop and test a system for rapid benefit-risk monitoring of vaccines using healthcare databases in Europe. The objective of this proof-of-concept (POC) study was to test the feasibility of the ADVANCE system to generate incidence rates (IRs) per 1000 person-years and incidence rate ratios (IRRs) for risks associated with whole cell- (wP) and acellular- (aP) pertussis vaccines, occurring in event-specific risk windows in children prior to their pre-school-entry booster. Methods: The study population comprised almost 5.1 million children aged 1 month to <6 years vaccinated with wP or aP vaccines during the study period from 1 January 1990 to 31 December 2015. Data from two Danish hospital (H) databases (AUH and SSI) and five primary care (PC) databases from, UK (THIN and RCGP RSC), Spain (SIDIAP and BIFAP) and Italy (Pedianet) were analysed. Database-specific IRRs between risk vs. non-risk periods were estimated in a self-controlled case series study and pooled using random-effects meta-analyses. Results: The overall IRs were: fever, 58.2 (95% CI: 58.1; 58.3), 96.9 (96.7; 97.1) for PC DBs and 8.56 (8.5; 8.6) for H DBs; convulsions, 7.6 (95% CI: 7.6; 7.7), 3.55 (3.5; 3.6) for PC and 12.87 (12.8; 13) for H; persistent crying, 3.9 (95% CI: 3.8; 3.9) for PC, injection-site reactions, 2.2 (95% CI 2.1; 2.2) for PC, hypotonic hypo-responsive episode (HHE), 0.4 (95% CI: 0.4; 0.4), 0.6 (0.6; 0.6) for PC and 0.2 (0.2; 0.3) for H; and somnolence: 0.3 (95% CI: 0.3; 0.3) for PC. The pooled IRRs for persistent crying, fever, and ISR, adjusted for age and healthy vaccinee period were higher after wP vs. aP vaccination, and lower for convulsions, for all doses. The IRR for HHE was slightly lower for wP than aP, while wP was associated with somnolence only for dose 1 and dose 3 compared with aP. Conclusions: The estimated IRs and IRRs were comparable with published data, therefore demonstrating that the ADVANCE system was able to combine several European healthcare databases to assess vaccine safety data for wP and aP vaccination

ADVANCE database characterisation and fit for purpose assessment for multi-country studies on the coverage, benefits and risks of pertussis vaccinations

Introduction: The public-private ADVANCE consortium (Accelerated development of vaccine benefit-risk collaboration in Europe) aimed to assess if electronic healthcare databases can provide fit-for purpose data for collaborative, distributed studies and monitoring of vaccine coverage, benefits and risks of vaccines. Objective: To evaluate if European healthcare databases can be used to estimate vaccine coverage, benefit and/or risk using pertussis-containing vaccines as an example. Methods: Characterisation was conducted using open-source Java-based (Jerboa) software and R scripts. We obtained: (i) The general characteristics of the database and data source (meta-data) and (ii) a detailed description of the database population (size, representatively of age/sex of national population, rounding of birth dates, delay between birth and database entry), vaccinations (number of vaccine doses, recording of doses, pattern of doses by age and coverage) and events of interest (diagnosis codes, incidence rates). A total of nine databases (primary care, regional/national record linkage) provided data on events (pertussis, pneumonia, death, fever, convulsions, injection site reactions, hypotonic hypo-responsive episode, persistent crying) and vaccines (acellular pertussis and whole cell pertussis) related to the pertussis proof of concept studies. Results: The databases contained data for a total population of 44 million individuals. Seven databases had recorded doses of vaccines. The pertussis coverage estimates were similar to those reported by the World Health Organisation (WHO). Incidence rates of ev

Quantifying outcome misclassification in multi-database studies: The case study of pertussis in the ADVANCE project

Background: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using European healthcare databases. Event misclassification can result in biased estimates. Using different algorithms for identifying cases of Bordetella pertussis (BorPer) infection as a test case, we aimed to describe a strategy to quantify event misclassification, when manual chart review is not feasible. Methods: Four participating databases retrieved data from primary care (PC) setting: BIFAP: (Spain), THIN and RCGP RSC (UK) and PEDIANET (Italy); SIDIAP (Spain) retrieved data from both PC and hospital settings. BorPer algorithms were defined by healthcare setting, data domain (diagnoses, drugs, or laboratory tests) and concept sets (specific or unspecified pertussis). Algorithm- and database-specific BorPer incidence rates (IRs) were estimated in children aged 0–14 years enrolled in 2012 and 2014 and followed up until the end of each calendar year and compared with IRs of confirmed pertussis from the ECDC surveillance system (TESSy). Novel formulas were used to approximate validity indices, based on a small set of assumptions. They were applied to approximately estimate positive predictive value (PPV) and sensitivity in SIDIAP. Results: The number of cases and the estimated BorPer IRs per 100,000 person-years in PC, using data representing 3,173,268 person-years, were 0 (IR = 0.0), 21 (IR = 4.3), 21 (IR = 5.1), 79 (IR = 5.7), and 2 (IR = 2.3) in BIFAP, SIDIAP, THIN, RCGP RSC and PEDIANET respectively. The IRs for combined specific/unspecified pertussis were higher than TESSy, suggesting that some false positives had been included. In SIDIAP the estimated IR was 45.0 when discharge diagnoses were included. The sensitivity and PPV of combined PC specific and unspecific diagnoses for BorPer cases in SIDIAP were approximately 85% and 72%, respectively. Conclusion: Retrieving BorPer cases using only specific concepts has low sensitivity in PC databases, while including cases retrieved by unspecified concepts introduces false positives, which were approximately estimated to be 28% in one database. The share of cases that cannot be retrieved from a PC database because they are only seen in hospital was approximately estimated to be 15% in one database. This study demonstrated that quantifying the impact of different event-finding algorithms across databases and benchmarking with disease surveillance data can provide approximate estimates of algorithm validity

Enhancing global vaccine pharmacovigilance: Proof-of-concept study on aseptic meningitis and immune thrombocytopenic purpura following measles-mumps containing vaccination

New vaccines designed to prevent diseases endemic in low and middle-income countries (LMICs) are now being introduced without prior record of utilization in countries with robust pharmacovigilance systems. To address this deficit, our objective was to demonstrate feasibility of an international hospital-based network for the assessment of potential epidemiological associations between serious and rare adverse events and vaccines in any setting. This was done through a proof-of-concept evaluation of the risk of immune thrombocytopenic purpura (ITP) and aseptic meningitis (AM) following administration of the first dose of measles-mumps-containing vaccines using the self-controlled risk interval method in the primary analysis. The World Health Organization (WHO) selected 26 sentinel sites (49 hospitals) distributed in 16 countries of the six WHO regions. Incidence rate ratios (IRR) of 5.0 (95% CI: 2.5-9.7) for ITP following first dose of measles-containing vaccinations, and of 10.9 (95% CI: 4.2-27.8) for AM following mumps-containing vaccinations were found. The strain-specific analyses showed significantly elevated ITP risk for measles vaccines containing Schwarz (IRR: 20.7; 95% CI: 2.7-157.6), Edmonston-Zagreb (IRR: 11.1; 95% CI: 1.4-90.3), and Enders'Edmonston (IRR: 8.5; 95% CI: 1.9-38.1) strains. A significantly elevated AM risk for vaccines containing the Leningrad-Zagreb mumps strain (IRR: 10.8; 95% CI: 1.3-87.4) was also found. This proof-of-concept study has shown, for the first time, that an international hospital-based network for the investigation of rare vaccine adverse events, using common standardized procedures and with high participation of LMICs, is feasible, can produce reliable results, and has the potential to characterize differences in risk between vaccine strains. The completion of this network by adding large reference hospitals, particularly from tropical countries, and the systematic WHO-led implementation of this approach, should permit the rapid post-marketing evaluation of safety signals for serious and rare adverse events for new and existing vaccines in all settings, including LMICs

Incidence Rates of Autoimmune Diseases in European Healthcare Databases: A Contribution of the ADVANCE Project

Introduction: The public–private ADVANCE collaboration developed and tested a system to generate evidence on vaccine benefits and risks using European electronic healthcare databases. In the safety of vaccines, background incidence rates are key to allow proper monitoring and assessment. The goals of this study were to compute age-, sex-, and calendar-year stratified incidence rates of nine autoimmune diseases in seven European healthcare databases from four countries and to assess validity by comparing with published data. Methods: Event rates were calculated for the following outcomes: acute disseminated encephalomyelitis, Bell’s palsy, Guillain–Barré syndrome, immune thrombocytopenia purpura, Kawasaki disease, optic neuritis, narcolepsy, systemic lupus erythematosus, and transverse myelitis. Cases were identified by diagnosis codes. Participating organizations/databases originated from Denmark, Italy, Spain, and the UK. The source population comprised all persons registered, with at least 1 year of data prior to the study start, or follow-up from birth. Stratified incidence rates were computed per database over the period 2003 to 2014. Results: Between 2003 and 2014, 148,947 incident cases of nine autoimmune diseases were identified. Crude incidence rates were highest for Bell’s palsy [23.8/100,000 person-years (PYs), 95% confidence interval (CI) 23.6–24.1] and lowest for Kawasaki disease (0.7/100,000 PYs, 95% CI 0.6–0.7). Specific patterns were observed by sex, age, calendar time, and data sources. Rates were comparable with published estimates. Conclusion: A range of autoimmune events could be identified in the ADVANCE system. Estimation of rates indicated consistency across selected European healthcare databases, as well as consistency with US published data

Incidence rates of narcolepsy diagnoses in Taiwan, Canada, and Europe: The use of statistical simulation to evaluate methods for the rapid assessment of potential safety issues on a population level in the SOMNIA study

BACKGROUND & OBJECTIVES: Vaccine safety signals require investigation, which may be done rapidly at the population level using ecological studies, before embarking on hypothesis-testing studies. Incidence rates were used to assess a signal of narcolepsy following AS03-adjuvanted monovalent pandemic H1N1 (pH1N1) influenza vaccination among children and adolescents in Sweden and Finland in 2010. We explored the utility of ecological data to assess incidence of narcolepsy following exposure to pandemic H1N1 virus or vaccination in 10 sites that used different vaccines, adjuvants, and had varying vaccine coverage.METHODS: We calculated incidence rates of diagnosed narcolepsy for periods defined by influenza virus circulation and vaccination campaign dates, and used Poisson regression to estimate incidence rate ratios (IRRs) comparing the periods during which wild-type virus circulated and after the start of vaccination campaigns vs. the period prior to pH1N1 virus circulation. We used electronic health care data from Sweden, Denmark, the United Kingdom, Canada (3 provinces), Taiwan, Netherlands, and Spain (2 regions) from 2003 to 2013. We investigated interactions between age group and adjuvant in European sites and conducted a simulation study to investigate how vaccine coverage, age, and the interval from onset to diagnosis may impact the ability to detect safety signals.RESULTS: Incidence rates of narcolepsy varied by age, continent, and period. Only in Taiwan and Sweden were significant time-period-by-age-group interactions observed. Associations were found for children in Taiwan (following pH1N1 virus circulation) and Sweden (following vaccination). Simulations showed that the individual-level relative risk of narcolepsy was underestimated using ecological methods comparing post- vs. pre-vaccination periods; this effect was attenuated with higher vaccine coverage and a shorter interval from disease onset to diagnosis.CONCLUSIONS: Ecological methods can be useful for vaccine safety assessment but the results are influenced by diagnostic delay and vaccine coverage. Because ecological methods assess risk at the population level, these methods should be treated as signal-generating methods and drawing conclusions regarding individual-level risk should be avoided